Beijing Academy of Artificial Intelligence (BAAI) has recently launched the world’s first Chinese large model debate platform, FlagEval Debate. This new platform aims to provide a novel measurement approach for evaluating the capabilities of large language models through a competitive mechanism of model debates. It is an extension of the FlagEval arena for large model combat evaluation services, designed to identify capability differences among large language models.

["Zhipu AI has released an evaluation benchmark AlignBench for Chinese large models", "AlignBench can evaluate the alignment level of models and human intentions in multiple dimensions", "The dataset is divided into 8 major categories, including knowledge Q&A, writing generation, role-playing, and various types of questions", "Developers can use AlignBench for evaluation and score using a robust scoring model", "By logging into the AlignBench website, users can submit their evaluations."]

SuperCLUE has released the August rankings for Chinese large models, featuring 5 different ranking evaluations that selected 16 general large language models, utilizing 3,337 new test questions. The performance gap between domestic large models on Chinese tasks and GPT-3.5 is narrowing.